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Description 



IP-enabled terminal for combined video-based entertainment and communication 
services • 

5 

Section 1. Problem of the invention 

There is currently great market interest in video-based services that can 
be offered to broadband subscribers, e.g. with an ADSL or VDSL connection. 

10 DSL technology enables a steadily growing number of users to bring video- 
based services into the living room. The definition of video-based services 
is that a substantial part of the information is transmitted in the form of 
video data. Apart from the transmission of pure video films, there is also 
great interest in providing video-based added value services. 

15 The IP-enabled terminal or Set Top Box (STB) described according to the 
invention integrates all hardware (HW) and software (SW) components in 
order to enable both the transmission of video films and video-based 
communication services. 

20 Section 2 . Previous solutions to the problem ■ 

Current solutions for video-based solutions via broadband connections offer 
either pure video entertainment services or video-based communication 
services such as, for example, video telephony. Thus STBs are known which 
25 only support video streaming or STBs which only support video telephony. 

Integrated STBs which can support both service categories were not known to 
date. 



30 



Section 3 . Solution to the problem according to the invention 

The STB according to the invention integrates all hardware and software 
components in one terminal to support at least one video-based communication 
service and at least one video-based entertainment service. Broadband access 
at the user's home and the broadband network infrastructure are prior art. 
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The STB according to the invention does not make any specific demands in ■ 
this regard (see application example in Section 5.) 
Such a combined STB permits the use of a wide range of video-based 
services. The following list provides a few examples of services: 
5 • Video on Demand/Pay per View/ Staggered Video/Digital Video Broadcast: 
These are essentially services which supply video data as a constant IP 
stream to the STB. 

• Internet over TV/Walled Garden: 

Pages in HTML format are displayed on the TV set. 
10 • Video Telephony: 

In parallel with voice connection via IP (VoIP) both subscribers can see 
themselves on the TV set connected to the STB. A camera (STB 
integrated/connected) records the video' information. 

• Instant Messaging /Chat: 

15 The TV set serves as a display device for received or transmitted text 
messages which are instantaneously exchanged between two or more 
subscribers. Text is input e.g. via an infrared (IR) keyboard. 

• Receipt /sending of SMS: 

The TV set serves as a display device for received or sent SMS messages. 
20 SMS are transferred between the video network and the mobile network via 
suitable transition servers (gateways). Text is input, for example, via an 
infrared (IR) keyboard. 

• E-mail : 

. The STB serves as an e-mail client and enables the sending and receipt of 
25 e-mails. Moving or fixed images can also be attached via the connected 
video camera. Text is input, for example, via an infrared (IR) keyboard. 

• Personal Video Recorder: 

The hard disk integrated into the STB permits the recording of TV 
broadcasts in digital format. 
30 • Games : 

Games can be loaded onto the STB locally or played online with other 
players. The connection of an external games console to the STB is also 
possible. 
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3.1 Hardware aspects of the STB 

Typically, the STB is connected to a TV set and uses this as 
an output device for all video information. For video-based 
5 communication services and in particular, for video telephony, 
the STB has a video camera for recording moving images of the 
subscriber . 

The following list describes the essential hardware components 
and connection options of the STB according to the invention: 
10 • Video Camera (integrated, external connection possible, no 
external cables) : For recording moving images. 

• Hard disk (integrated, can be connected externally, no 
external cables) : For storing video data. 

• Controller /DSP/Motherboard: Contains all the components to 
15 process the video data (e.g. processors, ASICs, passive 

components, memory chips) . As no STB controller chips which 
also support video encoding (which, for example, is necessary 
for video telephony) are currently available, an additional 
DSP (Digital Signal Processor) is employed. In this way, 
20 flexibility for future coding methods (e.g. Windows Media 9) 
is also achieved. 

• Power supply (integrated, external) 

• DSL connect ion /modem : Optionally the DSL modem can be 
integrated or external. For receipt or transmission. of data via 

25 DSL. Integration of the STB into the IP network via PPPoE, i.e. 
STB is assigned the IP address via PPPoE and Radius Server 

• TV connection: For connection to the TV. The connection is 
typically dependent on the country, e.g. SCART, S -Video 

• Telephone connection: In order for the telephone terminal 
30 to be used for voice transmission of video telephony, 

the terminal can be directly connected to the STB. Optionally 
the STB can also have a hands -free device (microphone and 
loudspeaker included) . 

• Keyboard connection (external connection possible, no 
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external cables) : For entering text information, e.g. for 
Instant Messaging. 

• Ethernet connection: To connect a personal computer (PC) 
so that any data can be exchanged via DSL at the same time as 

5 transmission of video data by means of PC, e.g. Internet 
surfing. 

• .Remote control (no external cables) : To control services, 
e.g. selection of services, leaf through pages, fast forward 
films, etc. 

10 • PCMCIA slot (integrated) : To insert PCMCIA cards, e.g. 
WLAN card. 

• Smartcard reader, (integrated, external) : To use Smartcards 
for certain services, e.g. to read codes when using encoding 
methods . 

15 • Memory card reader (integrated, external) : To read or 

store data from or on external standard memory cards, such as 

e.g. Memory Stick, CompactFlash Card. 

Loudspeaker (internal) : To transmit acoustic signals, e.g. 

when receiving an e-mail message. 
20 • Indicator lamp (internal) : To transmit optical signals, 

e.g. when receiving an e-mail message. 

• TV/cable tuner (internal) : To connect a cable to standard 
broacJcast TV channels. These can then be recorded, for example, 
by means of an internal hard disk. Furthermore, a cable tuner 

25 also permits parallel image within an image display of cable TV 
signals and video on demand TV signals. 

• USB connection: To connect peripheral devices, e.g. 
joystick for games which run on the STB. 

30 In Section 5 an exemplary embodiment of an STB according to 
the invention is described. 



PCT/EP2005/050077 / 2004P01306WOUS 

5 

3.2 Software aspects of the STB 

The software architecture on the STB integrates various 
software components which support parallel use of video-based 
5 entertainment and communication services. The principle here is 
that various applications for communication services and 
entertainment services can run in parallel on a shared 
operating system (e.g. Linux) . The software architecture 
permits the use of shared software components such as, for 
10 example, audio and video codecs for decoding or coding 

corresponding IP data streams. All software components are 
connected to an integrated software client and loaded into the 
STB. 

In Section 5 an exemplary embodiment of an STB software client 

15 according to the invention is described. 

Previously mentioned hardware /software components are not all 
mandatory components of the STB according to the invention. It 
is essential, however, that at least one component which 
supports a communication service (such as, for example, video 

20 camera, telephone terminal, codecs for video/audio coding, 

video telephony application) and at least one component which 
supports an entertainment service (such as Electronic Program 
Guide Browser, codecs for video/audio decoding, video on demand 
application) are integrated into an STB. 

25 

Section 4. Advantages of the solution according to the 
invention 

The primary advantage of the STB according to the invention is 
30 that an attractive bundle of innovative, video-based services 
can be offered via the domestic TV set. Video-based 
entertainment services can thus be supplemented by attractive 
communication services. The TV set is suitable both as a screen 
for video telephony and also as an input/output device for e- 



PCT/EP2005/050077 / 2004P01306WOUS 

6 

mails. 

Current solutions would require that the user connected two 
separate STB to his TV set to use video-based entertainment and 
communication services or that communication services only ran 
5 via the PC. Use of the TV set incl. STB also permits the use of 
communication services in the living room. This also makes it 
possible for service providers to canvass new customer groups 
with these services . 

An integrated STB also permits the use of integrated services 
10 such as, for example, the sending of e-mails between other 

users in the same integrated video network. 

Furthermore, use of the service can be optimized, e.g. by 

prioritizing services which are started via the STB Client by 

means of a corresponding client application. This is possible 
15 as all services are controlled by a shared STB Client and 

besides the TV set, the PC is also connected to the STB for 

Internet use. 

The use of a commercial STB controller chip in conjunction with 
an audio/video DSP for the hardware concept meets all the 

20 requirements for video services and communication services . The 
STB controller chips currently available contain only decoder 
algorithms for video signals. For video telephony, however, 
encoder algorithms are also required (for the image of the 
video telephony subscriber to be sent) . However, these can 

25 easily be loaded onto a DSP. For applications in DSL networks 
(see example in 5.3) with low bandwidths (e.g. 1.5 Mbit/s in 
the direction of the subscriber) it is necessary to support the • 
latest decoder /encoder algorithms, such as MPEG 4/10 or Windows 
Media 9. STB controller chips for video services with these 

30 decoder algorithms are not yet available today. Future STB 

controller chips will no doubt support these decoder algorithms, but 
in all probability not the encoder algorithms. 

The hardware concept according to the invention of combining an 
STB controller chip with a DSP therefore already makes it 
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possible to realize the STB according to the invention with 
existing STB controller chips. The DSP assumes all 
decoder /encoder tasks for video services and video telephony. 
The necessary decoder/encoder algorithms for this are simply 
5 loaded into the DSP (see also Figure 2) . 

Section 5. Graphic display of exemplary embodiment ( s ) or 
workaround ( s ) 



10 Figure 1 shows an example of an STB according to the invention. 
This does not contain all the components listed in Section 
3.1. In addition to the visible components, it is assumed that 
the following are also integrated into the STB: Hard disk, DSL 
modem, power supply unit. The legend for Figure 1 follows. 

15 

Legend for Figure 1 (front view) : 

1. Housing 

2. PCMCIA slot 

3. CompactFlash Card slot 
20 4. Camera (integrated) 

5. Indicator lamp 

6. Operational status indicator 

7. Network/ standby switch 

8. IR receiver 

25 

Legend for Figure 2 (rear view) : 
1 . Housing 

a. Network cable 

b. SCART jack 

30 c. Cable connection 

d. Ethernet connection 

e. Telephone terminal connection 
f . Telephone connection (a/b) 

g. USB 
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h. External keyboard 

. Figure 2 shows an example of the hardware concept of the STB 
according to the invention. This does not contain all the 
5 components listed in Section 3.1. 

Figure 3 shows an exemplary embodiment of STB software client 
architecture according to the invention. 

10 • Operating system: Shared operating system, for example, Linux or an 
MS Windows version. 

• Driver: software to control hardware components, e.g. an integrated 
hard disk. 

• Application coordination: This layer contains software parts 
15 which enable the various applications to work together in a 

coordinated manner. This layer may, for example, contain a Java 
Virtual Machine. 

• Video applications: Applications to control video-based 
entertainment services such as, for example, video on demand. 

20 • Communication applications: Applications to control video-based 
communication services such as, for example, video 
telephony. These may, for example, contain signaling stacks 
(H.323, SIP) or e-mail client applications. 

• Shared resources: This layer contains software components 

25 which can be used by all applications, e.g. codecs (MPEG 2, 
MPEG 4/10, H.263) 

An application example for the method according to the invention is 
shown in Figure 4. 
30 The simplified example shows a combined, video-based 

application of entertainment and communication services based 
on ADSL infrastructure. Normal PSTN telephony is via fixed 
telephone networks. The example described here is a video 
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service network ("overlay network") overlaid on the telephone 
network. 

The subscriber network is at the user's house. The IP-based data 
5 streams enter the DSL network via the STB. TV set, PC and telephone 
terminal are connected to the STB. The telephone terminal can be used 
for completely normal PSTN telephone conversations (via standard DSL 
splitter) or for voice over IP telephone conversations for the 
voice component of video telephony.. As a general variation of 
10 the subscriber network, a completely wireless solution is 

possible, i.e. all terminals are connected to each other via 
suitable radio-based signaling technologies such as, for 
example, DECT, wireless LAN, Bluetooth, IR. 

15 The DSL Access Network contains the standard components for 
ADSL such as DLAM, concentrator, BRAS and Radius database. 

In the network there are control servers for entertainment 
services and for communication services. Both have a signaling 

20 relationship with STB. For the control server for entertainment 
services, this can be, for example, HTTP or Java/XML-based. For the 
control server for communication services this can be, for example, 
SIP or H.323-based. Both servers can also have a signaling 
relationship with each other, e.g. for shared user authentication 

25 ("single sign-on"). 

This application example permits primary video telephony 
between subscribers of the video service network. Via an 
appropriate gateway, in principle, it is also possible to 
support video telephone calls with subscribers from other 

30 networks, e.g. UMTS subscribers. Compatible protocols and UMTS 
terminals with a camera and a compatible video telephony 
client are a prerequisite for this. 

Furthermore, in the network there are additional application 
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servers, such as, for example, video servers which contain 
films in digital form for video on demand, or e-mail servers 
from which the STB can load e-mails for the user. Direct access 
to servers on the WWW/ Internet .is still possible. The STB has 
corresponding signaling relationships for each application 
according to the prior art. The control servers can also have 
appropriate signaling relationships with the application 
servers, e.g. for data comparison regarding the current status 
of available films. 



